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Test System and Method 



Background 

Electronic systems must be tested. Failure of such systems during operation is 
considered to be catastrophic in many situations (for example, space-craft and missiles). 
5 Expensive suites of test equipment have been developed to test complex, high-value electronic 
systems. These test systems are matched to the design of the system to be tested. Therefore, the 
test equipment development cannot start xmtil the system to be tested is far down the design and 
development road, and the amount of time available to develop the test equipment is very short. 
In addition, inevitable changes to the design of the complex system to be tested, after test 



tio equipment development, result in a high cost to modify the test equipment to reflect that change. 



The test equipment is designed to a specification document, usually a "performance 
specification" or a "requirements" document. During the process of designing the test equipment 



p fi:*om the performance specification, elements of the point design of the equipment to be tested 



!p tend to "leak back" into the specification. Therefore, there is a need for test equipment design 
that, while being driven by the requirements of the tests to be performed, is derived 
independently. 

Generally, test equipment can be divided into two categories. The first category is 
termed Special Test Equipment (STE). This is equipment developed to perform a specific 
20 testing function. It is not suitable for testing items other than those it was designed to test. In 
contrast, General Purpose Test Equipment is used to test many unrelated components or systems. 
Unfortunately, current stand alone General Purpose Test Equipment is unsuitable for, most 
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Therefore, there is a need for a test equipment system that can be changed rapidly. 
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complex systems; the embedded functionality is too inflexible. Therefore, there is a need for a 
Several Purpose Test System that will service highly complex systems. 

For example, for missiles, onboard performance information during flight must be 
transmitted to ground receiver sites. A system of sensors, processors and telemetry transmitters 
5 is used to collect and transmit performance data and missile range safety tracking information to 
the groimd control site. A system of ground-test instrumentation is used to check out the system 
of flight instrumentation and telemetry equipment. Currently, as the performance and tracking 
system is developed, a special test equipment suite is developed at the same time. Detailed 
j^;! system test requirements documentation is not finalized until late in development; therefore, the 
i||) start of the test equipment development effort is delayed. Furthermore, the inevitable 

m 

m modifications to the system will cause the test equipment development to incur cost and schedule 

35 growth. Even further, post-development alterations of the system result in a high cost 
modification of the special test equipment. The hard-wired architecture of the test equipment 
results in a disincentive to modify system flight hardware due to the high cost of changing the 

15 test equipment. Accordingly, there is a need to develop general purpose test equipment capable 
of handUng specific systems, such as the example system above. 

There is also a need to reduce the schedule risks in development programs of test 
equipment and to provide a structure for increasing the assurance that performance requirements 
alone will drive the test equipment specification, and there is a need for test equipment design 

20 that requires a more clear and more complete definition of performance specification of test 
equipment early in the development process. 
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Summary of the Invention 



ill 
y 
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To be left blank until claims are finalized 
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Brief Description of the Drawing s 

Figure 1 shows a flow diagram of an example embodiment of the invention. 
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Description of Example Embodiments of the Invention 

Referring now to Figure 1, an example embodiment of the invention is seen in which 
performance specification docxjment (PSD) is provided in an electronic form in an electronic 
docxmient mark-up language (for example, Standard Generalized Mark-up Language (SGML)). 
5 According to one specific embodiment of the invention, electronic document PSD is in the 
Extensible Mark-up Language (XML). A specific advantage of the XML embodiment is that 
XML uses tags only to delimit pieces of data and leaves the interpretation of the tag completely 
to the application reading the data. According to an alternative embodiment, the electronic 
performance specification document (PSD) comprises an Hyper-Text Mark-up Language 
Clo (HTML) document. 

J;^ As seen in Figure 1, the performance specification document includes data in fields (for 

% example, Fl and F2), contained in records (Rl and R2)). The various records and fields of the 
i,^,, performance specification document are included in various sections S1-S4. The sections, fields 

rii 

and records are demarked by tags and attributes defined by formatting rules. The tags and 
(Is records include hierarchical divisions (for example, sections, jobs, blocks, steps, etc.). Further, 
the rules include which subdivisions are required and which are optional in various 
embodiments. 

According to other embodiments, the rules define which of fields Fl and F2 are required 
for the definition of the smallest record. According to one specific example, assuming a record 
20 is the smallest section of the performance specification document, the required fields include 
descriptions of instructions, notes, test-interface points, stimulus values, stimulus value units, 
measured values, measured value units, etc. The tags and attributes, therefore, include: (1) 
documentation related items such as hierarchical notations, tities, descriptions, and notes; (2) test 
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system related items (e.g., interface points and data codes); and (3) test specific items (e.g., 
stimulus and measurement values and units). 

According to other specific example embodiments, additional rules constraining the 
performance specification document (PSD) are derived firom test specifications and testing 
requirements for the unit under test. In some specific examples, those rules include the order of 
events (testing is required, in some embodiments, to proceed in a specific order to make a valid 
assessment of some functionality of interest) and lists of acceptable units (for example, the use of 
volts as a specification may be constrained to units of V), 

Referring still to Figure 1, the performance specification document (PSD) is read by 
mark-up language reader R which selectively generates delimited configuration file (DCF) 
and/or human readable document (HRD). Delimited configuration file (DCF) is used by general 
purpose test equipment (GPTE) to configure test equipment to test the system of interest (not 
shown). Human-readable document (HRD) is used by operation and quality-control personnel to 
review the design of the test. 

As a result of the example embodiment of Figure 1, parallel development of the test 
equipment and the system to be tested is provided, and changes to the system to be tested occur 
without changing the test system. Further, the traditional path for corruption of the performance 
specifications and requirements is eliminated by decoupling the requirements and specification 
development firom the test equipment point design. Providing the detailed test parameters and 
the delimited configuration file DCF allows for changes to the performance specification without 
changing the hardware or detailed software design of the test equipment. Thus, development of 
test equipment occurs sooner; changes during development have less impact on test equipment 
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development; and the fully-developed performance specification eliminates the need for test 
equipment driven changes to the performance specification. 

In one specific example embodiment, a performance specification document for a system 
calls for a system battery voltage test. The performance specification document includes the 
5 following definitions of related XML tags and attributes in accordance with World Wide Web 
Consortium XML Standards: 



10 



'■is 

m 
m 



30 



<1 ELEMENT section { section_name_id, section__description, section^note'^, io_block+}> 
< I ELEMENT section_narae_id (#PCDATA)> 
<!ELEMENT section_description (#PCDATA)> 
<! ELEMENT section_note (#PCDATA)> 

<! ELEMENT io_block ( job_io_block__id, io_block_description, io_block_action, 
io__st ep+) > 

<!ELEMENT j ob_io_block_id (#PCDATA)> 

<! ELEMENT io_block_description {#PCDATA)> 

<!ELEMENT io_block_action (#PCDATA)> 

<!ELEMENT io_step (job_io_step_id, io_step_description, io_step_interface, 

nominal_value, 

nominal_value__units , 

tolerance_maximuin__value , 

toler ancejrainiinum^value , 

f ail_response, 

data_code, 

test_id_prerequisite, 

test_code_id, 

performance_revision, 

notes* 

)> 



<!ELEMENT j ob_io_step_id (#PCDATA)> 
<!ELEMENT io__step__description (#PCDATA)> 
< i ELEMENT io_step_interf ace ( #PCDATA) > 

35 <! ELEMENT noininal_value (#PCDATA)> 

<1 ELEMENT nominal__value_units C#PCDATA)> 
<! ELEMENT tolerance_maximum__value (#PCDATA)> 
<!ELEMENT tolerance_minimuin_value (#PCDATA)> 
<[ ELEMENT f ail_response (# PCDATA) > 

40 <! ELEMENT data_code (#PCDATA)> 

<!ELEMENT test_id_prerequisite (#PCDATA)> 
<!ELEMENT test_code_id (#PCDATA)> 
<1 ELEMENT perf onnance_revision (#PCDATA)> 
<1 ELEMENT notes (# PCDATA) > 

45 



The performance specification document also includes the following XML test execution 



specification: 
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<?xml version="1.0" encoding-"utf-8"?> 

<!DOCTYPE section PUBLIC "-//Test Requirements //EN" "performance. dtd"> 
<section> 

5 <section__name_id>l</ section_naitie_id> 

<section_description>INSTRUMENTATION BATTERIES </section_description> 
<section_note></section_note> 
<io_block> 

< j ob_i o_b 1 o c k_id> 1< / j ob_i o_b 1 o c k_i d> 

10 <io_block_description>OUTPUT:</io_block_description> 
<io__block__action>OUTPUT</io_block_action> 

<io_step> 

< j ob_i o_s t ep_i d> 1 < / j ob__i o_s t ep_i d> 

<io_step_description>MEASURE BATTERY VOLTAGE</io_step_description> 
15 <io_step_interface>DMMl</io_step_interface> 
<nomina l_va 1 ue> 1 2 < /nomina l_va lue > 

<nomina l_va 1 ue_un its >VOLTS < / nomi na l_va lue_uni t s > 

< to le r ance_max imurn_va lue> +2 < / 1 o 1 e r ance_niaximum_value> 

< t o 1 e r ance^min imum_v a 1 ue> 2 < / 1 o 1 e r anc e__min imum_va 1 ue> 
20 <f ail_response>ALARM</f ail_response> 

<data_code>10000</data_code> 

<test_id__prerequisite>0</test_id_prerequisite> 
J < t e s t_c ode_i d> 4 < / 1 e s t_code_i d> 

Q <p e r f o nnance__r e vi s i on>< /pe r f ormance^r e vi s i on> 

11 <notes>*** VERIFY BATTERY VOLTAGE ***</notes> 
(|| </io_block> 

mi </section> 

W 



m 



Reader R, in a specific example, comprises a commercially available XML text editor 
(e.g. Arbortext Epic Editor) and several ACL text scripts written to derive a tab delimited text 

35 file that reads the XML formatted performance specification docmnent (PSD) and generates a 
tab-delimited configuration file for use with a Sun Solaris Workstation running the Solaris 8.0 
operating system, Sybase Enterprise Server data base, and lONA Orbix conmion object broker 
architecture software. The Workstation is networked to an embedded VXI computer (VXI 
PC/700) with Windows NT 4.0 operating system, lONA Orbix common object broker 

40 architecture software, and NI/VISA VXI interface software. The embedded computer is 
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connected via a common VXI chassis with an Agilent E1413C scanning A/D card as the voltage 
measurement device. The Workstation ingests the delimited configuration file and executes the 
voltage measurement via a common object broker architecture client and server. The client 
resident on the Workstation invokes server methods resident on the embedded computer to 
control execution of the voltage measurement and perform result evaluation. 

At the selection of the operator, a document is produced from the XML document in 
human-readable form (e.g., formatted for ease of reading, such as through a word-processor or in 
columnar format) for quality control. For example, the human readable form document is 
published, in some embodiments, firom the XML document using the Arbortext Epic Editor and 
ACL scripts. The general purpose test equipment mcludes a common object request broker 
architecture and a mark-up language enabled input that comprises reader R. 

The above embodiments are given by way of example only. Further example 
embodiments will occur to those of skill in the art upon review of the present specification 
without departing from the spirit of the invention which is defmed solely by the claims. 



P:\FILES\30710US\Patent Applicatioadoc 



9 



